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PREAMBLE 


The Standing Committee on Public Accounts held hearings on Section. 3.14 of 
the 1999 Annual Report of the Provincial Auditor on February 24, 2000. This 
report constitutes the Committee’s findings and recommendations on the audit of 
Provincial Highway Maintenance. 


The Committee would like to extend its appreciation to the officials from the 
Ministry of Transportation who attended these hearings. The supplementary 
documentation provided by the Ministry to the Committee was useful during the 
deliberations and in the preparation of this report. 


The Standing Committee on Public Accounts acknowledges the assistance 
provided by the Office of the Provincial Auditor, the Clerk of the Committee, and 
Research and Information Services during these hearings. 


INTRODUCTION 


The Ministry of Transportation sets road safety and maintenance standards, 
establishes and enforces user safety regulations, and sets policies for the 
provincial highways network. The Ministry is responsible for the network 
construction, rehabilitation, maintenance and repairs. 


The Ministry has contracted out a number of highway operations and maintenance 
services over several decades. The Ministry entered into a number of contracts 
with firms to provide maintenance services for approximately 6,800 kilometres or 
30% of the provincial road system by March 31, 1999. It had planned to have 
outsourcing fully implemented by Spring 2000. 


The Committee has endorsed the Provincial Auditor’s recommendations in the 
1999 audit report on Provincial Highway Maintenance and recommends their 
implementation. In this Committee report on the February 2000 hearings, the 
Public Accounts Committee has focused on several main themes. These include 
the use of alternative service delivery through a blended outsourcing model, 
assessment of contract savings from outsourcing, private sector 
accountability/reporting by contractors, the application of highway maintenance 
and safety standards, and project appraisals. 


AuDIT OBJECTIVES AND SCOPE 

The audit objectives were to assess whether the Ministry had adequate procedures 
in place: 

- to measure and report on program effectiveness; and 


- to ensure that the outsourcing initiative was managed with due regard for 
economy and efficiency and in compliance with legislation, policies, and 
contract terms and conditions. 





The Auditor concluded that although some performance measures had been 
developed, the Ministry needed to improve its procedures to measure and report 
on program effectiveness. The Ministry's procedures were not adequate to ensure 
that the outsourcing initiative was managed with due regard for economy and 
efficiency, and in compliance with legislation, policies, and contract terms and 
conditions. 


MEASURING AND REPORTING PROGRAM EFFECTIVENESS 
Effectiveness Measures 


The Provincial Auditor recommended that the Ministry should implement and 
monitor performance measures for highway safety improvements for both winter 
and summer maintenance activities, and gather the necessary information to 
determine whether its maintenance activities are cost effective in preserving and 
prolonging the life of the provincial highways. 


The Ministry of Transportation’s response to the audit indicated that it has 
implemented a new winter performance measure across the province, which will 
be used as the basis for the establishment of performance targets. The Ministry’s 
response indicated that the capital rehabilitation of roads and bridges is the 
dominant factor in prolonging the anticipated service-life of the infrastructure 
assets. Achievement of a longer service-life of a pavement may indicate an 
effective rehabilitation strategy that results in the lowest overall life-cycle costs. It 
is reviewing its maintenance management information system for the 
development of summer maintenance performance measures. In addition the 
Ministry is developing an integrated Asset Management Business Framework, 
which will improve performance prediction tools for the infrastructure 
management strategies. These tools will permit the Ministry to better measure the 
effectiveness of its highway preservation strategies. 


The audit report addressed safety and the increasing concern over maintenance 
levels based on data from 1979 on. The Ministry's performance measures did not 
link maintenance activities to preserving and prolonging the life of the highways. 


The Auditor concluded that the Ministry should conduct a province-wide 
assessment; however, the Ministry did not have sufficient information to complete 
such a measurement. Therefore, it was not possible to demonstrate that the 
maintenance activities have resulted in protecting the investment. 


Committee Hearings 


The Committee addressed the maintenance program, focusing on safety, 
sustainability, and asset preservation. During the 1990s the Ministry developed 
effectiveness measures for these program objectives. The Ministry monitors 
contracts through its audit capability, using periodic reviews, and maintenance co- 
ordinators provide spot reviews with quality assurance. Ministry staff oversees 
contract management. This Section of the report addresses maintenance concerns. 


The Ministry explained the continuum of activity in maintaining a highway, with 
reference to preservation maintenance activity, repaving sections, resurfacing and 
rehabilitation. Performance measures are used to evaluate infrastructure against 
established Ministry standards. For example, the Ministry uses a pavement index, 
and bridges and roadway are inspected regularly against established standards. 


The Ministry explained that it has used private contractors since the 1970s and 
affirmed that the private sector has delivered maintenance services to Ministry 
standards. The Deputy Minister reported that provincial maintenance standards 
are consistent with the best practices in other jurisdictions in Canada, and that the 
standards applied to private contractors reflect long-standing Ministry criteria for 
the maintenance of Ontario's highways. 


Performance Measures 


The Ministry has developed a system of performance measures around established 
activities to provide the public with performance standards by class of highway; 
for example, the average time from a winter storm to achieving bare pavement. 
The Ministry indicated that it has been successful on winter maintenance 
standards. 


The Ministry explained that an average highway lasts for 15 years. The Deputy 
Minister noted that the percentage of roads in good condition indicates whether 
significant capital investment is required over the next five-year period. To 
maintain a constant capital program, 66% of the capital stock would be in very 
good condition, through a costed five-year cycle. The capital stock indicator had 
dropped to below 40% at one point. Since 1995 the Ministry reported that it has 
had record levels of investment in capital infrastructure. 


The Ministry is trying to introduce a new measure - an optimal state of repair 
number: 


. It takes that 66% as 100%. With that 
investment, we've [Ministry] moved from 59% 
now to 81%. So 81% of the highways in Ontario 
are close to being in an optimal state of repair. 
We've made tremendous gains. 


. . . On the old measure it would have been 
54%. We've made tremendous gains that are 
quite evident. We've used the pavement index 
and other things to let us know where to invest 
in terms of highways that don't need more 
capital infusion in the next five years. 


Safety Record 


The Committee questioned the Ministry about concerns that certain communities, 
particularly those in northern Ontario, have road maintenance and safety 
problems. The Committee enquired about any documentation that the alternate 





service delivery system, whether managed outsourcing or area maintenance 
contracts, compromised safety on public highways. Prior to adopting the blended 
model, the Ministry had researched comparable jurisdictions and concluded that 
there is no evidence that safety would be compromised on Ontario highways 
through outsourcing. The Ministry indicated that highway safety is the number 
one priority, and that maintenance standards have not been reduced. During the 
hearings, the Ministry stated that the objective that Ontario place in the top ten 
safest jurisdictions in North America has been achieved. 


According to the Ministry of Transportation's Director for the Northern Region, 
suggestions that fatal collisions have been unusually high this winter in northern 
Ontario, or that these fatal collisions can be linked to the Ministry's outsourcing of 
highway maintenance are not accurate. According to the Director: 


Our collision statistics tell us [Ministry] that, on a 
provincial basis, the total number of fatal 
collisions has fallen significantly over the past 10 
years, by nearly half. In northern Ontario, there 
has also been a decline in fatal collisions. For 
example, in the late 1980s we experienced as 
many as 120 fatal collisions in a single year. In 
recent years, the total has been in the 70s, which 
clearly demonstrates a downward trend . .. 


The majority of fatal collisions in northern 
Ontario occur during the summer months, and 
they have been declining over the past 15 years. 
The total number of winter-month fatal 
collisions over the last 15 years has been 
essentially flat-lined; however, since 1993 there 
has been a general downward trend in winter 
fatal collisions as well. Our statistics also tell us 
that there is no relationship between fatal 
collisions and the outsourcing of winter 
highway maintenance. In fact, we found that 
thus far this winter, those areas of northern 
Ontario that have been outsourced have not 
experienced an increase in fatal collisions in 
comparison to those areas still serviced by MTO 
staff. 


Committee Recommendation 


The Committee is in agreement that the Ministry’s maintenance standards must be 
maintained in the delivery of provincial highway transportation, regardless of the 
service delivery model. 


The Committee acknowledges that the Ministry, through recent investments, has 
moved closer to an optimal state of repair. To maintain the substantial 
investments made on provincial highways, it is necessary to report on the state of 


repair attained, in terms of the longevity of the highway network and with 
reference to overall costs (fiscal 1999 and 2000). 


The Committee expressed concern about the implications of deferred repairs and 
the long-term cumulative impact on the provincial highway infrastructure. 


The Committee therefore recommends that: 


1. The Ministry of Transportation should report on its province-wide 
highway assessment to determine whether the maintenance program 
is meeting its goal of preserving and prolonging the life of the 
provincial highway network. This report should include the cost of 
restoring the network to the 1979 assessment level of 60% of the 
system with a good condition rating. 


Monitoring of Maintenance Services (Patrol Function) 


Highway patrolling is an essential component in highway maintenance. The 
Deputy Minister described the patrol function under outsourcing: 


¢« Managed Outsource: It involves Ministry staff managing and directing 
highway maintenance operations with contractors supplying equipment and 
staff to perform specific functions. Ministry staff patrol highways to 
determine when maintenance is required and to follow-up to ensure that work 
has been performed to standards. 


« Area Maintenance Contracts: The contractors assume all responsibility for 
maintenance within a specific geographic area. The Ministry monitors their 
work to ensure that standards are met. 


The Ministry responded in 1999 that the staffing levels and patrol zones are 
appropriate and that they provide quality assurance and maintenance co- 
ordination for contractors. 


Committee Hearings 


Some Committee Members expressed concern over the ability of patrols to carry 
out their surveillance responsibilities and in turn for the crews to deliver the 
required road safety levels and general maintenance standards. Some Committee 
Members commented that some patrol areas are large and difficult to monitor, 
given variable northern weather conditions over a given patrol shift. The Ministry 
confirmed that the patrols have been changed in configuration and that their 
average length has been increased slightly. 


Committee Recommendation 


The highway monitoring function is a key tool at the Ministry’s disposal to ensure 
that the highway infrastructure meets Ministry standards. Highway safety is a 
main priority and maintenance standards are checked through the regular patrols. 
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This surveillance function helps to ensure that contractors maintain the highway 
system to provincial standards. 


Some Committee Members have suggested that the patrol function has 
weaknesses and that upgrades may be required to ensure that provincial safety 
standards are met on a consistent basis and that contractors are in compliance with 
the terms of their contracts. 


The Committee therefore recommends that: 


2. The Ministry of Transportation should report to the Committee on 
its highway monitoring activities and their effectiveness in ensuring 
that minimum standards of highway safety and contractor 
performance expectations are achieved. 


DUE REGARD FOR ECONOMY AND EFFICIENCY 
Alternative Service Delivery Options 


The Ministry analysed several options for the delivery of road maintenance 
services including outsourcing. It was decided to use the following delivery 
methods: 


e« Managed Outsourcing Contracts (MO) - maintenance services would be 
contracted out and the Ministry would retain management responsibility. 


« Area Maintenance Contracts (AMC) - a contractor would assume the 
responsibility for all maintenance operations and the Ministry would monitor 
the contractor's work. 


A detailed cost analysis and risk assessment was done for each of the delivery 
methods. The Auditor compared the potential savings of the alternative service 
delivery methods against the Ministry's current direct delivery method. The 
Ministry’s business case showed that higher risks were associated with area 
maintenance contracts (AMCs) and overall, managed outsourcing (MO) had the 
potential for greatest savings and was the least risky option. 


The Ministry plans indicated that by the Spring 2000 nearly two thirds of the 
province's highways would be maintained using AMCs and the remainder using 
the managed outsourcing alternative. The Auditor recommended that to ensure 
that the maximum benefits are realised from the outsourcing initiative, the 
Ministry should evaluate each contract to determine which outsourcing method 
provides the taxpayer with the greatest actual savings and revise the 
implementation strategy where necessary. 


The Ministry's experience with AMCs and MO concepts resulted in a refined 
outsourcing model. According to the Ministry, the revised plan uses a 
combination of both AMCs and MOs in a blended approach. This offers several 
advantages over the one-concept strategy suggested in the original business case. 
Among the more significant demonstrated advantages is the ability to ensure 


greater competition, match contracts to local market conditions, allow greater 
industry participation and permit future flexibility in modifying contract areas and 
types. The blended approach also lowers risk levels relative to either alternative 
used on its own and will provide greater savings than either AMC or MO 
alternatives alone. 


The Auditor explained that outsourcing has been practised for a long time in 
Ontario; however, there was a dramatic shift in 1995 to AMCs. It was this move 
to the new methodology that was addressed in the 1999 report. 


Committee Hearings 
Blended Approach 


At the time of the hearings, approximately 85% of the highway network was 
maintained by the private sector and by July 31, 2000, almost the complete 
network will be maintained under this blended approach. 


The Committee asked for elaboration on the blended approach, specifically on 
savings. Cases were identified in which the tendered cost exceeded Ministry 
costs. The Ministry responded that safety standards have been maintained and that 
it would not award contracts above Ministry estimates. 


Advantages 

The Ministry began with one pilot, an area maintenance contract, and three sub- 
areas. The objective was to allow smaller contractors to participate, also 
permitting for the efficiencies of larger contracts in the AMCs. According to the 
Ministry, the blended approach has assured safety standards, and has provided 
savings. In the changing economy and market conditions, it enables the Ministry 
to select the more favourable outsourcing option. 


Financial Analysis 


In October 1996 the Ministry's business case was approved by the Management 
Board of Cabinet for the highway maintenance-outsourcing plan. The Ministry's 
implementation plan was divided into two phases: 


- Phase one was to implement a pilot area maintenance contract (AMC) 
followed by an AMC and a managed outsourcing (MO) contract in each 
region of the province. By August 31, 1997, the Ministry was to report to 
Management Board of Cabinet on the costs and benefits of each awarded 
contract before proceeding with phase two. 


« Phase two would be to carry on with either AMCs or MOs, whichever yielded 
the greatest benefit in phase one. The Ministry reported to the Management 
Board of Cabinet that the effective implementation of the outsourcing 
initiative would result in estimated cost savings of 5%, when fully 
implemented. 
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Contracts were awarded in five areas including the Chatham pilot district. The 
estimated savings in the pilot district were $900,000, but the Ministry could not 
provide the necessary detailed documentation to support this calculation. The 
Auditor reviewed the other four AMC contracts that were awarded during the 
1998/99 fiscal year, and noted a number of costs which were included in the 
Ministry’s estimates that required either adjustment or updating. Specifically, the 
Ministry based overhead costs for the two districts on 1995/96 data, whereas 
1997/98 data were used to calculate the overhead costs for the other two districts. 
The Ministry also included, in its estimated savings, imputed financing charges on 
the purchase of equipment. However, the Ministry did not consider the financing 
costs for all government cash flows, including cash flows to outsourcing 
contractors. 


The Auditor indicated that if all of these costs were factored out of the Ministry's 
estimates, outsourcing would result in estimated losses on three of the four 
contracts. The Auditor concluded that despite certain one-time savings, for 
example, the sale and lease of equipment, outsourcing might ultimately result in a 
significant increase in the cost of highway maintenance. Based on the Auditor’s 
calculations, the Ministry has not achieved the estimated 5% savings on these four 
contracts. Since these contracts represent almost 20% of the provincial highway 
network, future contracts will require significantly higher savings in order to 
achieve the overall 5% savings necessary for the effective implementation of the 
outsourcing initiative. An evaluation of actual savings is important to determine if 
projected savings from outsourcing highway maintenance services have 
materialised as anticipated. 


The Auditor recommended that to ensure that the outsourcing initiative actually 
results in better value for money for the taxpayer, the Ministry should reassess the 
estimated savings for the contracts awarded prior to renewal and modify its 
service delivery approach accordingly. Also, it should review its business case 
methodology for service delivery to ensure that outsourcing is in fact beneficial to 
the taxpayer. 


The Ministry explained that the financing costs for capital equipment, for 
example, should be included in the estimates of the cost to government for in- 
house delivery. The Ministry agreed with the Auditor’s recommendations and 
indicated that estimated cost savings will be reassessed prior to the renewal of 
contracts, and the Ministry will continuously review its business case 
methodology for service delivery. The Ministry pointed out that savings 
associated with subsequent awards indicate that the Ministry's savings target for 
the complete outsourcing initiative is likely achievable. 


Committee Hearings 


The Committee dedicated a significant part of the hearings to the Auditor’s 
evaluation of savings from outsourcing. At issue is the variance in the 
assessments of savings conducted by the Ministry and the Auditor. The 
Committee questioned the Ministry on its rationale for proceeding with the 
alternative service delivery model. 
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The Committee enquired about the estimated savings in the Chatham pilot district 
of $900,000, which the Ministry could not document. The Deputy Minister 
acknowledged that it was not possible to provide the detailed documentation and 
that attention was required on record keeping. The Ministry provided the Auditor 
with the contract bid price, but could not provide a breakdown of the savings 
estimate. The financial summary tables were insufficient during the audit to tie 
the numbers to the $900,000 as the Chatham pilot worksheets were not available. 
This was not the case with the four other contracts. The Auditor indicated that this 
information was required to substantiate the actual savings. 


The Committee requested supplementary information on the extension of the 
Chatham Area Maintenance Contract. The Ministry provided the following 
response to the Committee’s request for documentation on the $900,000 savings. 


The government savings in the Chatham highway maintenance 
outsourcing initiative reflect the difference between the estimated cost of 
the internal provision of the service as compared to the contract costs. The 
Ministry wishes to maintain the costs of internal service confidential for 
commercial reasons. Their disclosure will prejudice the economic interests 
of the Ministry by providing a target for future bids, and thereby 
eliminating the competitive bidding process and preventing the 
government from getting the best value for the taxpayers' dollars. Beyond 
the estimated savings already provided, the Ministry is therefore 
constrained in providing additional details. 


The Ministry stated that it had evaluated the pilot project on an ongoing basis 
during the project, rather than through a formal evaluation upon completion. 


The Ministry indicated that during the current year it will perform a detailed 
evaluation of the savings from the Chatham outsourcing contract. Savings for the 
first 3.5 years of the Chatham Area Maintenance contract are included in the 
overall Ministry savings estimate of 7.83%. 


Assessment Methodologies 


This section of the report provides an overview of the commentary during the 
hearings on the methodologies used by the Provincial Auditor and the Ministry of 
Transportation. The Ministry of Finance is presently developing a provincial 
assessment methodology for application to all provincial ministries. 


Auditor's Methodology 

The Auditor addressed the issue of the potential savings from outsourcing and the 
possibility of significant increases in maintenance costs over the long-term. 
According to the Auditor, there was agreement with the Ministry over the cost 
elements; however, the differences existed in the amounts. 


The Auditor explained the concerns over financing costs at the hearings: 
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. . . the financing costs are normally based on 
cash flows. We found that the assumption that 
was made by the Ministry was that if highway 
maintenance were to be done by the Ministry 
over the term of the contract under discussion, 
which was three and a half years, the Ministry 
had, firstly, taken in all the proceeds on disposal 
or leasing the facilities and the equipment to the 
contractors who were taking over to determine 
whether there would be a benefit from the 
outsourcing, but at the same time had made the 
assumption that virtually on day one of the 
contract term the Ministry itself would have to 
spend $13.8 million on equipment, and made 
then the further assumption that because they 
didn't have to do that if they outsourced, they 
would have 5.3% interest on that $13.8 million 
[vehicle replacement cost] as a saving over the 
term of the contract if they did it in-house. 
That's what we disputed. We did not see the 
necessity for this, because we found and agreed 
with the Ministry on the inclusion of about $4 
million worth of equipment costs, renewing the 
existing equipment over the term of the contract. 


The Provincial Auditor was not in agreement on equipment maintenance. On 
financing costs, the Auditor concluded that they should have been applied to the 
total cash flow difference between the two approaches, which was approximately 
$300,000, rather than $13.8 million. The Ministry agreed to reassess these figures, 
with the exception of the calculation on the financing costs on capital. 


Ministry's Methodology 


The Ministry reported that it has responded to the Auditor’s findings and 
recommendations by determining which outsourcing method provides the greatest 
actual saving and then revising the strategy accordingly; reviewing the current 
tendering practices to ensure that excessive costs are not incurred; evaluating all 
contractors upon completion of existing contracts before new ones are awarded. 
The Ministry indicated that it has experience in tendering and awarding contracts 
and that it has exceeded the 5% savings indicated in the initiatives, regardless of 
the methodology applied. The Ministry is at 85% outsourcing, up from the 20% at 
the time of the audit, and it is achieving the savings initially identified in the 
Ministry business case. 


The Committee questioned whether there were real savings or only estimates. 
According to the Deputy Minister, the Ministry is clear on the costs and is of the 
opinion that it has prima facie evidence of the savings on every contract. It was 
acknowledged that there is a dispute about the methodology used, but the 
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Ministry indicated that it knows the project costs as they are based on the bid 
prices. 


The Deputy Minister explained that the area of contention is over indirect costs in 
the accounting and cost methodology, centred on the financing of capital 
equipment. The Ministry stated that the Auditor concluded that the Ministry was 
using overhead data that was out of date and the main issue was the application of 
the cost-of-financing data with respect to the financing of capital equipment. 
Subsequently the Ministry obtained current information and appropriate overhead 
data. The Ministry has recalculated saving totals at the point of 85% outsourcing, 
and there is approximately 1% difference in savings applying the Auditor’s and 
Ministry’s methodology. In each case savings exceeded 5%, according to the 
Ministry. 


The Ministry provided the following statement on the savings realised: 


The Provincial Auditor was looking at a 
circumstance where we had around 20% 
outsourced. Irrespective of the methodology 
used, we are confident that at 85% we have 
saved over the 5%. We also believe that by 
using this approach--the number of companies 
across the province which have bid, the 
opportunities we have for small companies to 
bid and give us good prices and efficiency, the 
opportunities for companies to become larger 
and provide more management services--we are 
very confident that we are creating, by the 
procurement and tendering processes we're 
using, the kind of competition and competitive 
environment that will lead to continued cost 
savings. 


The Committee asked for documentation with evidence of the savings. The 
Ministry explained that its response would be limited by the fact that some 
information is confidential and commercial intelligence is a constraint. The 
following table indicates estimated savings of 6.56%, based on the adjustments 
recommended by the Provincial Auditor. 





Highway Maintenance Outsourcing Savings for 
Contracts Awarded prior to March 1 2000* 


Annual Savings to Government 


Annual Percent 
($000,000) Savings 
Total MTO estimate of 
Government costs 106.509 
Total Contractor Bid Prices 98.174 
Savings to Gov’t Sooo 7.83 % 


** This number reflects adjustments based on comments made by the Provincial Auditor and 
acknowledged by MTO as appropriate. 


If the Ministry’s understanding of all adjustments pursuant to the 1999 Provincial 
Auditor’s Report are carried forward, the savings to government would be 
reduced as follows: 


Annual Percent 
($000,000) Savings 
Savings to Government (from 
above) S300 
Subtraction for Cost of Capital (1.020) 
Other issues (e.g. overhead rates and 
other minor calculation differences) (0.430) 
Resultant Savings Estimate 6.885 6.56% 


per Follow-through of Audit 


Adjustments 


One-time savings have not been included in the above figures. 


Savings/Costs estimates in this section refer to the outsourcing in the 
following areas: Chatham (AMC), Sault Ste. Marie (MO), Kenora (MO), 
New Liskeard (AMC), Ottawa/Kingston (AMC), Bancroft/Port Hope 
(AMC), London (AMC), Sudbury (AMC), Toronto East (AMC), Barrie 
(AMC), Bancroft/Peterborough (AMC), North Bay (AMC), Thunder Bay 
(AMC), Niagara/Mississauga (AMC). 


*This information was prepared by the Ministry of Transportation for the Standing Committee on 
Public Accounts, dated March 10, 2000. 


The Ministry indicated that it believed that it was using an appropriate 
methodology for the financing of capital equipment, which entails issues of 
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ownership, maintenance, depreciating and replacement. According to the 
Ministry, it has updated information in these areas and it is meeting the 
commitment to save the 5%, irrespective of the methodology used. The Ministry 
concluded that the results have been positive and that it will proceed with the 
negotiation of new outsourcing contracts. 


Proposed Provincial Methodology 


The Ministry of Finance is in the process of developing a government policy to 
resolve the methodological argument over the financing of such projects. The 
Ministry of Transportation informed Legislative Research and Information 
Services on July 11, 2000 that the Ministry of Finance and the Management 
Board Secretariat are in the process of defining the use of cost of 

capital in business case development. The Deputy Minister pointed out that this is 
a government-wide issue. 


Committee Recommendations 


The Committee has concluded that the proposed Ministry of Finance 
methodology will help to resolve the discrepancy between the Ministry and the 
Office on the Provincial Auditor on the actual savings realised through the 
outsourcing projects. The pilot contract and the four contracts, following their 
first full year of operation, would therefore be subject to financial analyses using 
this new methodology. 


The standardised provincial methodology would provide the Committee and the 
Provincial Auditor with the following information: 


« Ministry assessment of contract savings from outsourcing for the Chatham 
pilot contract and the four contracts; and 


¢ changes in overall highway maintenance costs for the fiscal years 1999 and 
2000, attributable to outsourcing. 


In a letter to the Committee from the Ministry of Finance, dated September 5, 
2000, the Office the Controller confirmed that an inter-ministry committee has 
been established to review and consult on the formalisation of the Directive on 
“Costing and Pricing of Government Services”. The Provincial Controller 
explained that the Directive under review is to provide direction on the use of the 
cost of capital in business case development. The Directive is to be published in 
approximately nine months (May 2001). 


The Committee therefore recommends that: 


3. The preparation of the Directive on Costing and Pricing of 
Government Services is a high priority item and should be finalised as 
soon as possible in 2001. 


The Committee has acknowledged that the Ministry’s primary objective in the 
outsourcing initiative is to realise savings. On this basis, the Committee asked the 
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Ministry to review all contracts and report back on actual savings, while 
protecting the identity of these contractors. 


The Committee therefore recommends that: 


4. The Ministry of Transportation should report to the Standing 
Committee on Public Accounts on the overall highway maintenance 
costs for the last two fiscal years, including the reductions in overhead 
achieved through outsourcing. The analysis should address the actual 
savings achieved from outsourcing the pilot contract, scheduled to end 
on April 30, 2000, and the four contracts at the end of their first year 
of operation. The proposed provincial methodology should be 
incorporated in the analysis, pending the finalisation of the Directive 
on the Costing and Pricing of Government Services. 


5. The Ministry of Transportation should provide an analysis of the 
difference in aggregate highway maintenance costs between fiscal 
1999 and fiscal 2000, indicating any reductions in overhead achieved 
through outsourcing. The Ministry should take into account the 
provisions of the Directive on the Costing and Pricing of Government 
Services. 


Maintenance Information System 


The Ministry's District Direct Input System (DDIS) is used to record maintenance 
information. It includes information on labour, materials and equipment. The 
system's manual notes that one of the most important requirements of an effective 
system for managing the highway maintenance program is the reporting of 
accurate and meaningful data. The Ministry intends to use the system's 
information to prepare its estimate of maintenance costs to be used when 
evaluating future bids, including bids from the incumbent contractor. 


The information will be entered directly by the contractors. The Auditor found 
that procedures were not in place requiring Ministry staff to verify the accuracy 
and completeness of the information provided by the contractors. Ministry staff 
generally followed up on large variances between contractor information and 
historical information. 


The Provincial Auditor recommended that to ensure that the District Direct Input 
System provides accurate and complete information for management decision 
making, the Ministry should establish procedures, such as periodic on-site 
verification by existing employees, to obtain the necessary assurance that 
information submitted by contractors is reliable. 


In response, the Ministry indicated that it is in agreement with the importance of 
accurate information to manage the highway maintenance program and maintains 
that monitoring the computer input by contractors of maintenance information is 
being carried out. The Ministry will, however, create a more formalised process 
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that will include periodic reviews to ensure that DDIS input appropriately reflects 
the work being done. 


Committee Hearings 


The Committee enquired about the reporting mechanism standards and contract 
monitoring under DDIS. The Ministry indicated that it has a new system for 
record keeping with revised standardised diaries for all Ministry employees with a 
work-order record system. Initially the Ministry had collected information 
informally, without standardised reporting. 


The new system includes periodic reviews of area maintenance contracts. Staff 
has been trained on this system, ensuring that records are maintained on a 
consistent basis across the province. The Ministry is developing a formal central 
registry with an appraisal system for contractors, similar to the system for the 
major outsource component on the capital side. 


Through the DDIS. the Ministry is now receiving biweekly updates based on the 
contractors’ data that is formally tracked on a regular basis, with a program of 
audits. Area maintenance co-ordinators are responsible for the verification of this 
information. In MOs, the Ministry is directly responsible for data entry into the 
DDIS. 


Committee Recommendation 


The Committee acknowledges the importance of comprehensive record keeping 
through DDIS in the broader accountability structure. The operational success of 
the DDIS system is dependent upon ongoing evaluation to ensure effectiveness, 
based on accurate and complete information for management decision making. 
On-site verification is necessary to obtain assurance that the information 
submitted by contractors is reliable. 


The Committee therefore recommends that: 


6. The Ministry of Transportation should provide the Standing 
Committee on Public Accounts with a report on the operation of the 
Direct Data Input System for the current fiscal year. 


COMPLIANCE WITH POLICIES/PROCEDURES AND CONTRACT TERMS 
Contract Performance Evaluation 


Ministry policy requires the preparation of a formal evaluation at the completion 
of a contract to ensure that it has received the best value for the money expended 
and that the contractor's performance was satisfactory. Since none of the area 
maintenance contracts had been completed, there were no evaluations for review. 
However, in one district where managed outsourcing contracts had been 
completed, the Auditor noted that subsequent contracts were awarded without 
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consideration given to the past performance of the contractors. The most current 
contract performance evaluations on file were done in 1997. 


The Provincial Auditor recommended that to ensure that only competent 
contractors are selected and that the best value for the funds expended is received, 
the Ministry should formally evaluate all contractors upon completion of 
maintenance service contracts and before awarding subsequent contracts. In 
addition, the Ministry should develop a system to allow regions to share 
information regarding a contractor's past performance. 


The Ministry indicated that it is considering a review of the Maintenance 
Contractors' Performance Appraisal System for all maintenance contracts along 
with a pre-qualification system for major maintenance work (similar to 
construction pre-qualification). Under a maintenance pre-qualification system, 
poor performance could result in a reduced rating and ability to bid on Ministry 
maintenance contracts. Ministry policy requires Maintenance Contractors’ 
Performance Appraisals to be performed on maintenance contractors. Those who 
perform in an unsatisfactory manner may be prohibited from bidding on any 
Ministry contracts for a period of time. A system to compile a provincial database 
on maintenance contractor appraisals is being considered. 


Committee Hearings 


According to the Ministry, several provisions have been introduced to ensure that 
standards are met, by providing contractors with exact criteria at the tendering 
stage. These procedures verify that contractors are financially and technically 
qualified to ensure contract success, with attention to all parameters including 
public safety. For example, the Ministry has taken the following steps to ensure 
standards in contracts: 


. [establishing] the right standards, which 
we [the Ministry] believe we have, if those 
standards are well and clearly described in a 
contract, if you have a system that properly 
screens and looks at the technical competence of 
your contractors and the contractors therefore 
are monitored on the spot with audits by 
individuals who have a responsibility for quality 
assurance, and that information 1s collected and 
used, penalties are in place in the contract for 
any abuse . . . 


The Deputy Minister reported that provincial maintenance standards are 
consistent with the best practices in other jurisdictions in Canada, and that the 
standards that private contractors must achieve reflect long-standing Ministry 
standards governing the maintenance of Ontario's highways. A contract standard 
violation results in financial penalties, and there is a comprehensive verification 
monitoring program and a strict enforcement code. Contracts can be cancelled in 
cases of non-compliance and sanctions are imposed on future b.dding. 
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On the completion of a project, Ministry policy requires performance appraisals 
for maintenance contractors. The proposed maintenance contractor's performance 
appraisal system will be used to track contractors, particularly at the pre- 
qualification stage. 


The Ministry explained the role of standards to ensure accountability through 
contractors: 


The standards are our foundation for this whole 
quality assurance sense . . . We have excellent 
capability to translate standards into contract 
language to make sure that the contractors fully 
and absolutely understand the standards. We 
have management information systems that 
allow and require them in the contract to 
provide us with the information we need on 
records. We have ways of verifying that. We 
have ways of monitoring that. We have 
requirements that they do the work in 
accordance with the contract they sign and we 
have quality assurance techniques to make sure 
we can oversee to our responsibility that they 
are indeed doing what they contracted to do. 


Committee Recommendation 


The Committee has concluded that Contractor Performance Appraisals are 
required on outsourcing contracts upon completion to ensure value for money. 


The Committee therefore recommends that: 


7. The Ministry of Transportation should prepare a Contractor 
Performance Appraisal for all outsourcing contracts upon completion. 
An appraisal document must be taken into consideration in the 
process of selecting and awarding a subsequent outsourcing contract. 


Highway Transfers (Pilot Extension) 


The Provincial Auditor recommended that to maximise the benefits of the 
outsourcing initiative, the Ministry should consider not exercising the two-year 
option on the pilot area maintenance contract and either re-tender or switch to an 
alternative delivery method that is more cost effective. 


Committee Hearings 


The Committee asked for information on the assessment/review process 
conducted on the Chatham pilot project, prior to granting the two-year renewal. 
The Ministry responded that it looked at the quality of the service provided and it 
concluded that the quality of service was excellent, and that the Ministry 
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standards had been met. The Assistant Deputy Minister of Operations explained 
that the contract was renewed on the basis of the work being completed to 
standard, and in certain areas standards were exceeded. 


The Ministry provided the following supplementary information on the contract 
extension: 


The two-year extension to the Chatham Area 
Maintenance Contract runs from May 1, 2000 to 
April 30, 2002. The contract calls for a lump 
sum payment $5,246,821 for the first year of the 
extension and an increase in the second year of 
1.7% for inflation. The terms for extension 
were detailed in the original Request for 
Proposal. 


All other terms and conditions for maintenance 
of Provincial highways in the original Area 
Maintenance Contract remain essentially 
unchanged, with the exception of the decrease in 
the total number of kilometres (due to highway 
transfers). 


Committee Recommendation 


The Committee has concluded that an internal review of the pilot project is 
necessary, in compliance with Ministry policy, to ensure value for the money, and 
more specifically that the contractor's performance was satisfactory. The review 
of a firm’s overall performance is essential information for a contract extension 
decision. 


The Committee therefore recommends that: 


8. The Ministry of Transportation should provide the Standing 
Committee on Public Accounts with details on the decision to renew 
the Chatham pilot project. 


MINISTRY RESPONSE TO COMMITTEE REPORT 


The Standing Committee on Public Accounts requests that the Ministry of 
Transportation provide a comprehensive response to this Committee report to the 
Committee Clerk within one hundred and twenty days of the tabling of this 
document. 


APPENDIX A 


DISSENTING OPINION OF THE ONTARIO LIBERAL CAUCUS 
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Please accept this dissenting opinion, on behalf of Dalton McGuinty and the 
Ontario Liberal caucus, to the Provincial Highway Maintenance report prepared 
for the Standing Committee on Public Accounts. 


We have several concerns regarding the committee's findings with regard to this 
issue. I will outline them as best I can using the issues raised in the report itself. 


MEASURING AND REPORTING PROGRAM EFFECTIVENESS 


The Deputy Minister of Transportation stated during Committee Hearings that 
"provincial maintenance standards are consistent with the best practices in other 
jurisdictions in Canada, and that the standards applied to private contractors 
reflect long-standing Ministry criteria for the maintenance of Ontario's highways" 
(Page 3 - Report.) She went on to state that, "The Ministry...had been 
successful on winter maintenance standards." However, later in the report, on 
Page 5, the, "Ministry confirmed that the patrols have been changed in 
configuration and that their average length has been increased slightly." Ministry 
insistence that standards have not decreased appear to be incorrect. The 
experience in Northern Ontario and other districts which now have expanded 
patrol areas has been a slower and inconsistent reaction time to inclement 
weather conditions by private contractors with both AMCs and MOs. There are 
concerns in the public, and Ontario Liberals share those concerns, that 
reductions in Ministry staff and the fact that private contractors are only on call 
and not at the Ministry garage have created this slower reaction time. The 
Ministry's public insistence of no reductions in maintenance standards continues 
to ring hollow. 


We have concerns about a plan by the Ministry of Transportation, discussed 
during Committee Hearings, to introduce a new measure - an optimal state of 
repair number that, "takes 66% [roads in good condition] as 100%," in that we 
believe that this new measure will be used by Ministry officials to create the false 
impression with the public that the state of Ontario's roads are in much better 
condition than they actually are. 


We dispute the report given at Committee by the Ministry of Transportation's 
Director for the Northern Region that fatal collisions were not unusually high last 
winter in northern Ontario, or that fatal collisions could not be linked to the 
Ministry's outsourcing of highway maintenance. His report that the fatal collision 
rate had decreased since the 1980s overall fails to take into account several 
factors which have generally contributed to such lower rates, such as improved 
driver behaviour and seat belt use. The general trend downward he quotes 
would seem to have little or nothing to do with the trend toward privatization of 
road maintenance. His information did not include up-to-date information on the 
winter of 1999/2000, a mild winter by all accounts, in which the fatal collision 


rate in Northwestern Ontario alone had climbed to 14 by the end of January 
2000. With AMCs and MOs now fully implemented in Northwestern Ontario in 
mid-2000, we are only beginning to realize the impact of the program in practical 
terms in my part of the province. 


In addition, the Ministry has not conducted a province-wide highway assessment 
to determine whether the maintenance program is meetings its goal of 
preserving and prolonging the life of the provincial highway network, especially 
in northern Ontario. 


We disagree with Committee recommendation #2 in that it doesn't go far 
enough in ensuring that the Ministry of Transportation must prove that its 
highway monitoring activities and their effectiveness in ensuring that standards 
of highway safety and contractor performance expectations are achieved. The 
Ministry is merely asked to report to the Committee on its activities. The Ministry 
must be willing to conduct independent and fair audits of all contracts on a 
regular basis to ensure that standards are being met and we believe they must 
set up such a clear and transparent monitoring program to ensure that. We are 
not convinced that the Ministry is committed to ensuring that strict monitoring 
takes place, and instead is choosing to rely on the "good will" of private 
contractors. 


DUE REGARD FOR ECONOMY AND EFFICIENCY 


We fully agree with the Auditor's assessment that the Ministry has not achieved 
5% savings on four contracts audited in his 1999 report. In fact, since these 
contracts represent almost 20% of the provincial highway network, we agree 
that future contracts will require significantly higher savings in order to achieve 
the overall 5% savings necessary for the effective implementation of the 
outsourcing initiative. The Ministry failed to adequately respond to these findings 
during Committee, only insisting that the financing costs for capital equipment, 
for example, should be included in the estimates of the cost to government for 
in-house delivery, which by and large, is no longer occurring. 


We are particularly concerned about the Ministry's failure to provide a detailed 
documentation of the estimated savings in the Chatham pilot district, which were 
Said to be $900,000. The Ministry stated that, "The government savings in the 
Chatham highway maintenance outsourcing initiative reflect the difference 
between the estimated cost of the internal provision of the service as compared 
to the contract costs. The Ministry wishes to maintain the costs of internal 
service confidential for commercial reasons." This statement is extraordinary 
because it gives the Ministry the ability to fail to disclose in any accredited way 
the actual cost savings of the privatization program. This is an unacceptable 


position, especially considering the conflict between the Provincial Auditor and 
the Ministry in terms of accounting for savings. 


PROPOSED PROVINCIAL METHODOLOGY 


The Ministry of Finance is in the process of developing a government policy to 
resolve the methodological argument over the financing of all government 
contracts. The report states that the, "Committee has concluded that the 
proposed Ministry of Finance methodology will help to resolve the discrepancy 
between the Ministry and the Office of the Provincial Auditor on the actual 
savings realised through the outsourcing projects." We disagree with this 
statement. We have little hope that the discrepancy will be resolved, in light of 
the fact that the Ministry has stated that it will not document the estimated costs 
of the internal provision of services to prove that estimated savings have been 
achieved. In addition, we continue to agree with the Auditor that the financing 
costs of capital should be included in Ministry calculations and we suspect that 
the Directive on Costing and Pricing of Government Services will not give the 
Ministry adequate direction to ensure that financing costs are calculated 


properly. 
COMPLIANCE WITH POLICIES/PROCEDURES AND CONTRACT TERMS 


The Auditor noted that in one district where managed outsourcing contracts had 
been completed, subsequent contracts were awarded without consideration 
given to the past performance of the contractors. The most current contract 
performance evaluations on file were done in 1997. 


Page 16 of the Report states: "The Auditor recommended that to ensure that 
only competent contractors are selected and that the best value for the funds 
expended is received, the Ministry should formally evaluate all contractors upon 
completion of maintenance service contracts and before awarding subsequent 
contracts. In addition, the Ministry should develop a system to allow regions to 
share information regarding a contractor's past performance." We fully agree 
with these recommendations. However, the Committee simply recommended 
that the Ministry, "prepare a Contractor Performance Appraisal for all outsourcing 
contracts upon completion." The Committee did not specify some of the 
important conditions of such a C.P.A. program, which were outlined by the 
Ministry as considerations, such as a provincial database on maintenance 
contractors appraisals. In addition, it is inadequate that an appraisal document 
must only be taken into consideration in the process of selecting and awarding a 
subsequent outsourcing contract. Private contractors who fail to meet the 
standards outlined in a Contractor Performance Appraisal must see their ability 
to bid and receive subsequent maintenance contracts greatly affected. The 
Ministry has indicated that they are considering a policy whereby those who 


perform in an unsatisfactory manner may be prohibited from bidding on any 
Ministry contracts for a period of time. I recommend that those who perform in 
an unsatisfactory manner must be prohibited from bidding on any contracts for 
a period of time. In addition, poor performance must result in a reduced rating 
and ability to bid on Ministry contracts. 


We are also concerned that private contractors have shown an unwillingness to 
perform over and above the minimum standards as outlined in Ministry contracts, 
without charging great amounts to the Ministry for additional compensation. An 
example of these costs would be purchasing additional salt for highways during a 
major snowstorm. These additional costs were formerly and frequently absorbed 
by Ministry officials at little cost. We suspect that these additional costs, if 
incurred, are adding unexpected increases to the overall costs of the program. 
But more disturbing is that reluctance to incur additional costs on the part of 
private contractors, who are in compliance with contract specifications, is 
compromising the quality and the safety of the roads for which they are 
providing service. In my region of the province, we continue to experience road 
closures due to inclement weather and the failure of many private contractors, 
sometimes under Ministry direction, to be pro-active in terms of winter highway 
maintenance. These frequent road closures, which seem to be increasing in 
recent years, continue to cause a great amount of inconvenience to local 
residents and have a negative impact on the economy of Northwestern Ontario. 


IN CONCLUSION 


The Ministry frequently failed to prove its case to the Committee on a variety of 
matters, only insisting that standards were still being met and that savings were 
being achieved. Most disturbing was their inability to provide the Committee 
with evidence that estimated savings had been achieved largely because it was 
unwilling to publicly reveal the costs of internal service delivery. This fact gives 
the Ministry the freedom to insist that promised savings are being achieved, 
without any need to document that publicly. In addition, the Auditor's 
disagreement with the accounting practices of the Ministry with regard to 
financing costs of capital continues to be a big concern. We do not believe that 
the Ministry of Finance proposed Directive on Costing and Pricing of Government 
Services will resolve this matter in any significant way. As a result, we will 
continue to have two conflicting opinions as to the actual costs of this 
privatization scheme. 


What's become very clear is that the government's movement towards full 
privatization of highway maintenance is not achieving the estimated savings 
promised of 5%. In fact, we have learned that this program may ultimately cost 
the taxpayers far more. In addition, the quality of our highways may be 
compromised as a result of this government's determination to proceed with this 


privatization scheme. The program is proceeding full speed ahead under a cloak 
of suspicion, a cloak which the Ministry seems determined to maintain. 


We continue to believe that an independent review and audit of all Area 
Maintenance and Managed Outsourcing Contracts that have been signed 
between the Ministry of Transportation and private sector companies must be 
held immediately. This government and this Ministry simply cannot be trusted 
when they say that private maintenance contracts are achieving their promised 
savings without compromising public safety and road quality. 


Sincerely, 


dl Lak 


Michael Gravelle, M.P.P. 
Thunder Bay-Superior North 
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